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(57) Disclosed herein is a connection bandwidth 
management process and system for use in a high 
speed packet switching network. The network compris- 
es a plurality of switching nodes interconnected through 
a plurality of communication links. Each of the switching 
nodes comprises means for switching packets from at 
least one input link to at least one output link. Each of 
the output links are coupled to at least one buffer in the 
switching node for queuing packets before they are 
transmitted over the output link. Each of the communi- 
cation links supports the traffic of a plurality of user con- 
nections statistically multiplexed overthe link. Each user 
connection is allocated an initial agreed-upon band- 
width through the network, with each of the communi- 
cation links being possibly oversubscribed. 

The connection bandwidth management process 
according to the invention comprises the steps of: 

Link monitoring data on the communication links 
are periodically received in a network monitoring center, 
and stored in a computer memory in the network moni- 
toring center. Then, one monitored link is selected and 
the corresponding link monitoring data are retrieved 
from the computer memory. The link monitored data re- 
trieved for the selected link is analyzed, and it is deter- 
mined whether the selected link is oversubscribed or 
not. If it is determined that the selected link is oversub- 
scribed and that the link monitoring data for the selected 
link satisfies at least one predetermined condition the 
bandwidth initially allocated to each of the connections 
boarded on the selected link is reallocated, such that, 
the sum of the reallocated bandwidth of the connections 



boarded on the selected link is less or equal to the total 
bandwidth capacity of the selected link. 

The process recycles until all the monitored links 
have been selected. 
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Description 
Technical Field 

[0001] The invention reiates to liigh-speed packet 
switciied networks. iVIore particularly, the invention re- 
lates to a connection bandwidth management process 
and system which rely on an efficient monitoring of the 
network resources occupancy to re-compute the band- 
width allocated to connections boarded on a given link 
so that the overall bandwidth capacity of the link is not 
exceeded. 

Background Art 

[0002] The emergence of high speed networking 
technologies such as ATM cell-based or Frame Relay 
based technologies, now makes possible the integration 
of multiple types of traffic having different quality of sen^- 
ice requirements (QoS), like speech, video and data, 
over the same communication network, thereby often 
referred to as broadband network. The communication 
circuits which may be shared in such network include 
transmission lines, program controlled processors, 
nodes or links, and data or packets buffers. Traffic QoS 
requirements are taken into account during the path se- 
lection process, and can be defined as a set of measur- 
able quantities or parameters that describe the user's 
perception of the sen/ice offered by the network. Such 
parameters include the connection setup delay, the con- 
nection blocking probability, the loss probability, the er- 
ror probability, the end-to-end transit delay and the end- 
to-end delay variation also referred to as jitter Real-time 
traffics have more constraining requirements than non- 
real-time ones i.e. end-to-end delays and jitters. It is 
necessary to be able to give priority to the real-time 
packets in order to minimize these delays. Meanwhile, 
the packet loss must be guaranteed both for real-time 
and non-real-time applications which have resen/ed 
bandwidth in the network, while it is not mandatory for 
non-resen/ed type of traffic. 

In this context, network users want the ability to request 
and be granted service level agreements (SLAs). An 
SLA is a (possibly contractual) agreement by the net- 
work provider to supply a guaranteed level of connec- 
tivity for a given price. The agreement is reciprocal, the 
user also commits not to go beyond a certain level Of 
network usage. The level of connectivity can be ex- 
pressed in many ways, including the following: the 
Bandwidth (number of bits per second), the Latency 
(end-to-end delay), the Availability (degree of uninter- 
rupted sen/ice), the Loss Probability the Security (guar- 
antee that only the intended parties can participate in a 
communication). 

Another important Objective of the networks providers is 
to optimize the network resources utilization. Indeed, 
communication networks have at their disposal limited 
resources to ensure an efficient packets transmission, 
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and while transmission costs per byte continue to drop 
year after year, transmission costs are likely to continue 
to represent the major expense of operating future tel- 
ecommunication networks as the demand for bandwidth 

s increases. More specifically considering the wide area 
networks (also referred to as backbone networks), the 
cost of physical connectivity between sites is frequently 
estimated at 80% of the overall cost. The connectivity 
can come in the form of a leased line, X.25 service, 

10 frame relay bearer service (FRBS), ATM bearer service 
(ATMBS), X.25 or a virtual private network ... As higher- 
speed links become available, the cost per bit may de- 
crease, but the absolute cost of links will remain signif- 
icant. Therefore, there is a need to minimize the net cost 

'5 per transmitted bit for all connectivity options and link 
speeds. Minimizing the cost per bit means squeezing 
the maximum possible utilization out of every link. 
Thus, considerable efforts have been spent on design- 
ing flow and congestion control processes, bandwidth 

20 reservation mechanisms, routing algorithms to manage 
the network bandwidth and do network capacity plan- 
ning i.e. optimize the configuration of the established 
connections (bandwidth allocated, path selected ...). In 
order to comply with both optimizing network resources 

25 utilization and guaranteeing satisfactory SLAs to the 
network customers, high speed networks generally in- 
clude monitoring software systems to monitor the status 
of their nodes and links. These monitoring systems typ- 
ically rely on counters implemented at switching node 

30 level. From a network resources monitoring point of 
view, the most important counters are those which re- 
flect the behavior of the "bottleneck" resources of the 
network because they will also reflect the end to end 
behaviour or quality of the service delivered. In high 

35 speed networks, the switching nodes are generally 
oversized in terms of performances compared to the 
communication links. As a matter of fact, switching 
nodes are "one time cost" for a network owner while 
lines cost is recurrent for example in a month period ba- 

40 sis in case of leased lines, and is also much higher as 
previously stated. In order to minimize the overall cost 
of a network, communication lines are sized in order to 
handle the traffic requirements but no more, and accord- 
ingly their throughput is always less than that of a switch- 
es ing node. Therefore, in a high speed network, commu- 
nication links generally constitute the "bottleneck re- 
sources". 

Links utilization data are typically expressed in terms of 
percentage of bandwidth utilized per unit of time. Links 

so utilization is typically evaluated as follows. 

Considering a link I whose maximum speed (i.e. band- 
width) is S cells/packets per second (where S denotes 
an integer), and assuming that the counters values as- 
sociated with that link are polled every T time units 

55 (where T denotes an integer, e.g., T = 15 minutes). 
Then, the computed utilization estimation U(l) of link I 
associated with each measurement time inten/al T 
would be expressed by the following formula: 
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where N denotes the number of cells/packets received 
during measurement period T, and where T Is expressed 
in seconds. U(I)t is expressed in percentage of linl^ uti- 
lization. 

[0003] These link utilization values which are compute 
ed every time inten/al T (e.g. T=15 minutes) and peri- 
odically retrieved may be processed in a statistics server 
associated to the network to compute an average link 
utilization wnich is the average of link utilization values 
U(l)j computed during a day, several days or weeks. 
Nowadays, modern high speed packet switching net- 
works can support hundreds of thousands of connec- 
tions. IVIoreover, tens to hundreds of connections may 
be configured for each newly subscribed user to the net- 
work. Besides, it is very seldom that a customer knows 
the amount of bandwidth required for each of his con- 
nections. In addition, network customers usually take 
some margin in the bandwidth requested for their con- 
nections to anticipate an increase of their traffic needs. 
The foregoing results in that an important difference is 
observed between the bandwidth reserved (i.e. con- 
tracted) by the customers' connections and the actual 
bandwidth used. 

In another hand, a satisfying assumption widely consid- 
ered by large networks providers is that, due to the im- 
portant number of customers boarded, the diversity of 
the locations, and the different types of sen/ice request- 
ed, there is a very low probability to observe a high 
number of connections active at the same time. 
Therefore, in this context, in order to maximize the net- 
work resources utilization, network providers typically 
practice what is cohimonly known as "overbooking" or 
"oversubscription" of their network links. That is, taking 
advantage of the statistical multiplexing of connections 
over the links, they allow more connections to be estab- 
lished on a link than the link may theoretically accept 
with regard to its total bandwidth capacity 
However, the link oversubscription technique suffers 
from the shortcomings that if a certain number, higher 
than the initial assumptions, of the customers boarded 
on the oversubscribed link increase significantly their 
traffic (still within their agreed-upon reserved band- 
width) and/or a certain number, higher than the initial 
assumptions, of customers' connections are active at 
the same time, then an unpredictable link congestion 
may occur. Such a congestion would induce a random 
discarding of packets in excess over the link, as all con- 
nections' traffic is categorized non-excess (green) traffic 
as it stays within the reserved bandwidth. 
Such a random discarding of packets may affect one 
connection more than another, depending on the time 
at which the congestion arises, and this goes against 
the fairness principle which should be applied to the dif- 
ferent customers. Besides, in such an oversubscription 
situation, there is no minimal bandwidth guaranteed per 
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connection. 

[0004] Therefore, there is a need for a connection 
bandwidth management technique that would permit at 
least the same number of connections to be boarded on 

5 a given linkthan when using the typical oversubscription 
technique, while solving its shortcomings. In particular, 
such technique should provide a better control of the 
network behaviour in case of congestion, and guarantee 
a minimum bandwidth available to each connection 

10 boarded on the link. 

Summary of the Invention 

[0005] A main object of the invention is therefore to 

'5 provide a connection bandwidth management process 
and system which rely on an efficient monitoring of the 
network resources occupancy to re-compute the band- 
width allocated to connections boarded on a given link 
so that the overall bandwidth capacity of the link is not 

20 exceeded, while solving the shoilcomihgs of the classi- 
cal oversubscription technique. 
[0006] In brief, in accordance with the appended set 
of claims, these objects are achieved by providing a con- 
nection bandwidth management process and system for 

25 use in a high speed packet switching network. 

The network comprises a plurality of switching nodes 
interconnected through a plurality of communication 
links. Each of the switching nodes comprises means for 
switching packets from at least one input link to at least 

30 one output link. Each of the output links are coupled to 
at least one buffer in the switching node for queuing 
packets before they are transmitted over the output link. 
Each of the communication links supports the traffic of 
a plurality of user connections statistically multiplexed 

35 overthe link. Each user connection is allocated an initial 
agreed-upon bandwidth through the network, with each 
of the communication links being possibly oversub- 
scribed. 

The connection bandwidth management process ac- 
40 cording to the invention comprises the steps of: 

Link monitoring data on the communication links are pe- 
riodically received in a network monitoring center, and 
stored in a computer memory in the network monitoring 
center. 

45 Then, one monitored link is selected and the corre- 
sponding link monitoring data are retrieved from the 
computer memory The link monitored data retrieved for 
the selected link is analyzed, and it is determined wheth- 
er the selected link is oversubscribed or not. 

so If it is determined that the selected link is oversubscribed 
and that the link monitoring data for the selected link 
safisfiesat least one predetermined condition the band- 
width initially allocated to each of the connections board- 
ed on the selected link is reallocated, such that, the sum 

55 of the reallocated bandwidth of the connections boarded 
on the selected link is less or equal to the total bandwidth 
capacity of the selected link. 

The process recycles until all the monitored links have 
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been selected. 

[0007] More specifically but not necessarily, the link 
monitoring data received for each monitored link in- 
cludes a time distribution of the occupancy of the buffer 
(s) associated to the link, which is measured during a 
predetermined monitoring time period. Details on how 
this time distribution of buffer occupancy is obtained can 
be found in dependent claim 3. 
Therefore, by relying on a close monitoring, at switching 
node level, of the occupancy slate of buffers which ac- 
cordingly reflects the character bursty or non-bursty of 
the traffic boarded over the network links, reallocation 
of the bandwidth of a link connections will be subject to 
some predetermined conditions on the character bursty 
or non-bursty of the traffic flowing over the link. 
[0008] In a preferred embodiment, the high speed 
packet switching network is a Frame Relay network, and 
a connection bandwidth Is reallocated by re-computIng 
the folldwing connection bandwidth parameters: 
The committed information rate (CIR), the committed 
burst size (Be), and the excess burst size (Be). 
Furthermore these connection bandwidth parameters 
are re-computed in such a way that the same amount 
of traffic is accepted through the network for the con- 
nection after its committed information rate (CIR) has 
been re-computed. 

[0009] The new CIR allocated per connection is a 
guaranteed minimum bandwidth available for each con- 
nection user, as the sum of the new CI Rs for all the con- 
nections of a given link is less or equal to the total band- 
width capacity of the link. This also induces fairness be- 
tween connections in case of packets discarding due to 
a congestion. 

[0010] Further features of the invention are set out in 

the dependent claims 

Brief description of ttie Drawings 

[0011] In the detailed description to follow, reference 
will be made to the accompanying drawings where like 
reference numerals are used to identify like parts in the 
various views and in which: 

FIG. 1 is a schematic diagram of a typical high 
speed packet/cell switching network supporting dif- 
ferent types of applications; 

FIG. 2 is a schematic diagram of a high-level view 
of the internal structure of a typical switching node 
of the network of FIG.1; 

FIG. 3 is a schematic diagram showing the main 
queuing points of a switching node according to 
FIG. 2; 

FIG. 4 is a schematic diagram showing the location 
where packet/cell counters are typically implement- 
ed in a switching node according to FIG. 2; 



FIG. 5 is a flowchart illustrating a buffer occupancy 
monitoring process according to the invention; 

FIG. 6 is a schematic block diagram illustrating a 
5 general network management architecture of a high 
speed packet switching network; 

FIGs. 7A-7B illustrates the contents of a Connection 
Table (FIG. 7A) and of a LinkTable (FIG. 7B) in ac- 
10 cordance with the invention; 

FIG. S Is a flow chart illustrating the Connection 
Bandwidth Right Sizing (CBRS) process of the in- 
vention. 

75 

Detailed Description ot the Invention 

[0012] In the detailed description to follow, the term 
"packet" refers to either a cell i.e., a small fixed-size 
20 packet such as in ATM (asynchronous transfer mode) 
networks, or a variable size packet such as In IP or 
Frame Relay networks. 

[0013] Referring to FIG. 1 there is shown atypical high 
speed packel/cell switching network wherein connected 
25 user applications generate different types of traffic over 
the network. Network 100 comprises four access 
switching nodes 101 to 104, and two Internal switching 
nodes 105, 106. Network nodes are interconnected by 
network links e.g. 1 07, also referred to as trunks. A rout- 
so er 110 transmits LAN (local area network) batch traffic 
in IP (Internet Protocol) format at a rate of 512 Kbps 
(thousands bits per second) over the network, via ac- 
cesis node 101. A host computer 111 sends SNA (Sys- 
tems Network Architecture) traffic at a rate of 64 Kbps 
35 to network access node 102, Attached to access node 
103 is a Frame Relay Access Device (FRAD) 112 for 
transmitting voice or video data over the network. With 
such different applications sending traffic over the net- 
work, it is then usual in such network that a switching 
40 node transmits data from connections having different 
traffic profiles. 

In FIG. 1 , access node 104 outputs data over the same 
external 64 Kbps transmission line, from connections 
originating from router 110 (IP data), from Host compu- 

45 ter 111 (SNA data), and FRAD 112 (voice data). Thus, 
the difficulty for such network Is to provide each connec- 
tion with ttie pre-specified quality of service (QOS). In- 
deed, some connections are very delay-sensitive as 
voice or video; other are not sensitive to delays but re- 

50 quire a very low packet/cell loss in order to behave cor- 
rectly, with limited retries. 

[0014] Referring now to FIG. 2, there is shown a 
switching node which can be either an access node or 
an internal node of the network. Communication to the 
55 node is accomplished by means of adapters compo- 
nents 220 which connect communication lines 250. 
Switching fabric 210 connects the various adapters at 
very high speed. Each adapter connects on one side to 
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external lines via line interface couplers (LICs) 260 and 
on the other side to one port (270) of the cell/packet 
switch 210. Packets are received over the external lines 
250, either a trunk i.e. an internal link or a port i.e. a 
network access link. Each of these packets is associat- 
ed with one network connection wtiich is either starting^ 
transiting or terminating in this node. Accordingly, adapt- 
ers can be of two different types, that is, access adapters 
or transit adapters. Access adapters establish data 
communication from outside to inside the network, i.e. 
from network attached data terminal equipment (DTE) 
to network access nodes. Transit adapters, in the other 
hand, ensure data transmission between nodes inside 
the network. Each adapter being access or transit 
adapter includes two parts : a receive part 230 and a 
transmit part 240. Receive part 230 receives data flow 
entering the node while transmit part 240 outputs data 
flowf rom the node towards another node (the next node 
of the path) or to a destination DTE, via communications 
lines 250. 

Access adapters also support the task of Call Admission 
Control (CAC), that is, the process of analysing the pa- 
rameters of a new connection in order to decide whether 
the connection should be accepted or not, in function of 
the availability of the network 's resources. Another im- 
portant task performed by access adapters in their re- 
ceive part, is to control the entering flow from a connec- 
tion and policing the traffic in function of its compliance 
to the connection agreed-to traffic descriptors. This po- 
licing function comprises marking packets, as excess 
(red packets) or non-excess (green packets), and dis- 
carding. In the other hand, transit adapters do not in- 
clude such marking function, they may only apply a se- 
lective packet discarding, and inanage entering traffic 
e.g. by performing routing functions. 
Each network node further includes a series of queuing 
elements for queuing incoming and departing packets. 
Queuing is preferably implemented at adapter level 
rather than at switch level because the process speed 
of the switch itself (switch fabric 210) is generally much 
higher than the process speed of an adapter. Thus, 
these queuing elements are essentially located at 
adapter level, as described hereinafter in connection 
with FIG. 3. 

[0015] Referring to FIG. 3, there is shown the main 
queuing points of an adapter in a switching node. It is to 
be noted that the term "queues" stands for what is typ- 
ically meant under the terms buffers, buffer memories, 
or queue memories; and the expression "queuing 
points" stands for specific locations in an adapter where 
such queues/buffers are implemented. 
In adapler 220, four queuing points can be identified, 
two (330, 340) are located at thetransmit part 240 of the 
adapter, and two others (310, 320) are located at the 
receive part 230 of the adapter. On adapter receive part 
230, once a packet has been received from one of the 
output lines 250, a receive process 360 is performed. 
Such a receive process 360 includes connection polic- 



ing, routing, statistics updates, CRC (Cyclic Redundan- 
cy Checksum) checking. Depending on the architecture 
of the adapter, the receive process is implemented by 
means of a specific hardware logic, or through a proc- 

5 essor enabled software. The software solution provides 
more flexibility but it is generally less efficient in terms 
of performance (i.e., number of packets processed per 
time unit) than the specific hardware solution, and con- 
sequently a queue 31 0 may be implemented for queuing 

10 incoming packets arriving faster than being processed 
by receive process element 360. Generally this queuing 
is limited to compensate for potential bursts of packets. 
A second queue 320 of adapter receive part 230 may 
be implemented to compensate for potential congestion 

'5 of switch 210, but this queuing is negligible as switches 
are generally designed to operate faster than adapters. 
Now regarding the adapter transmit side, a packet that 
passes from switch 210 to adapter transmit part 240, is 
firstly queued in switch output queue 330 before it is 

20 processed in transmit process elemetit 350. Transmit 
process element 350 determines the destination output 
line (250) to transmit packets over. Queue 330 is thus 
intended to compensate for a lower processing rate of 
transmit process 350 compared to the arrival rate of in- 

2S coming switched packets, depending on the implemen- 
tation type (software/hardware) of the adapter. Gener- 
ally when the implementation is software, the adapter 
processor running the code is designed to sustain a pre- 
determined transmit packet rate larger than the corre- 

30 sponding line speed, and queuing of packets in queue 
330 is limited to compensate for potential bursts of pack- 
ets. Before they are transmitted over destination output 
lineis, packets are queued in adapter output queuing 
point 340. As network links are generally designed to 

35 sustain the traffic characteristics offered and no more 
(for cost-effective reasons), when congestion occursthe 
first resources to be saturated are generally the links. 
Consequently adapter output queues constitute the 
major queuing element in the switching node to com- 

40 pensate for congestion at link level. In view of the fore^ 
going reason, the implementation of the present inven- 
tion focuses on adapter output queuing point 340 that 
is, the switching node output transmission queues. The 
importance of output queuing point 340 is expressed 

4S through the number of different traffic management fea- 
tures proposed at this level by the different network pro- 
viders. Output queuing point 340 comprises a plurality 
of queues (i.e. buffer memories) which may achieve per 
priority queuing, per connection queuing, faimessqueu- 

50 ing etc. or a combination thereof. 

[001 6] Now referring to FIG. 4, there is shown the lo- 
cation where packet/cell counters are typically imple- 
mented in a switching node according to FIG. 2. In the 
receive part 230 of adapter 220, a first set of counters, 

55 receive counters 410 (CNT1 ), is responsible for count- 
ing incoming packets, as well as counting erroneous 
packets. Still in adapler receive part 230, a second set 
of counters, accept/discard counters 420 (CNT2), are 
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coupled to the policing process performed within receive 
process 360. The policing process is the function which 
verifies the compliance of the traffic supported by a giv- 
en connection to the contract subscribed (SLA). If the 
connection traffic is above the agreed-upon traffic then 
pacl^ets may be discarded or tagged. Thus, counters 
420 are responsible for counting pacltets that are tagged 
or discarded, as well as those that are accepted. Now, 
in transmit part 240 of adapter 220, counters are also 
implemented: a third set of counters 430 (CNT3) is re- 
sponsible for counting packets as soon as they have 
been received from switching fabric 210, as well as 
packets discarded due to overflow of the corresponding 
buffers (queues 330 of FIG. 3). Finally a fourth set of 
counters 440 (CNT4) is implemented for counting pack- 
ets when they leave queues 340, just before they are 
boarded over transmission links 250. All the four sets of 
counters are implemented globally per adapter, then per 
port, per class of service, and possibly per connection. 
As previously stated, from a network resources moni- 
toring point of view, the most important counters are 
those which reflect the behavior of the "bottleneck" re- 
sources of the network because they will also reflect the 
end to end behaviour or quality of the service delivered. 
These counters are accordingly counters 440 (CNT4). 
However these counters provide numbers that do not 
take Into account the possible burstiness of the traffic 
and therefore allow to compute link utilization statistics, 
that lack accuracy 

[0017] According to the invention, there is provided a 
new technique of network resources monitoring based 
on queues occupancy monitoring rather than merely 
counting packets that are boarded to the outgoing links 
of the nodes, as typically performed by counters 440 
(CNT4), The principle is to measure the occupancy of 
each of the "bottleneck" queues, i.e., queues 340 each 
time a packet is admitted to one of these queues. While 
this technique will be described hereinafter with refer- 
ence to one memory queue, it should be understood that 
each of the memory queues 340 is monitored in the 
same manner. 

Buffer occupancy monitoring principle 

[0018] The principle of buffer/queue occupancy mon- 
itoring relies on defining for each queue 340 a plurality 
N (N is an integer) of thresholds T(1) to T(N) expressed 
in terms number of packets or bytes stored in the queue. 
For ATM networks they would be expressed in number 
of cells, while for packets of variable size such as for 
Frame Relay networks, they would be expressed in 
number of bytes. The total number of cells/bytes stored 
in the queue at a given instant, is referred herein to as 
the expression "queue size" and noted Qsize. Thresh- 
olds T(1 )-T(N) are chosen so as to correspond to differ- 
ent percentages of occupancy of the queue, function of 
its total capacity. In relation with these N thresholds, a 
number N of queue states, ST(1)-ST(N), are defined 



with regard to the comparison of the queue size with the 
thresholds 1(1 )-T(N). Queue states ST(1 )-ST(N) are de- 
fined as follows: 

ST(1 ): Queue state when T(1 ) <= Qsize < T(2); 



Queue state when T(p-1) <= Qsize < T(p); 



ST(N-1 ): Queue state when T(N-1 ) <= Qsize < T(N); 



'5 ST(N): Queue state when C 



>= T(N). 



where "<=" stands for "less or equal to", and ">=" stands 
for "greater or equal to". 

[0019] Further, a number N of counters, PT(1 )-PT(N), 
20 are implemented. Each counter PT(i) (with I comprised 
between 1 and N) is incremented when the queue state 
(Queue_State) is found to be at any of the states ST(i) 
to ST(N). 

[0020] In the preferred embodiment of the invention, 
25 four (N=4) thresholds are defined: T(1), T(2), T(3), T(4) 
which correspond to 5%, 20%, 40% and 70% of the total 
queue capacity. Associated to these thresholds, queue 
states ST(1) to ST(4) are thus defined as follows: 

30 ST(1): Queue state when T(1) <= Qsize < T(2); 
ST(2): Queue state when T(2) <= Qsize < T(3); 
ST(3): Queue state when 1(3) <= Qsize < T(4); 
ST(4): Queue state when Qsize >- T(4). 

35 [0021] Four counters PT(1)- PT(4) are implemented. 
For example, as explained above, counter PT(2) would 
be incremented if queue state is determined to be any 
of the states ST(2), ST(3), ST(4). 
[0022] The overall process of queue occupancy mon- 
40 itoring will now be described in connection with FIG. 5. 
In the preferred embodiment of the invention, this proc- 
ess is implemented In the fprm of a computer program 
within the transmit process 240 (FIG. 3) in the adapter 
transmit part 220. 
46 [0023] In FIG. 5, the process of queue occupancy 
monitoring according to the invention starts at start box 
501. Then, at box 503, an I NIT step is performed where 
all the N counters PT(i) with i comprised between 1 to 
N are Initialized to zero. Still in box 503, a new monitor- 
so ing time inten/al (period) T is started. In next box 505, 
when a new packet is received from the switching fabric, 
its size PS is extracted from its header. It should be not- 
ed that In case of ATM cells, the cell size is fixed and 
the queues sizes are expressed in number of cells. 
55 Then, decision box 507 is entered to check if the queue 
can accept this packet. That is, current queue size 
(number of cells/bytes currently stored in the queue) in- 
incoming packet size PS should be less 



6 



11 



EP 1 069 801 A1 



12 



than the maximum capacity, Max_Queue, of the queue. 
If not (NO) box 509 is entered in which aii counters PT 
(i) with i from 1 to N are incremented, and finally the new 
pacl<et is discarded as it cannot be stored in the queue 
The process then continues with decision box 515. Con- 
versely, if the new packet can be enqueued (YES), box 
511 is entered in which the new packet is accepted in 
the queue, and accordingly current queue size (Qsize) 
is overridden with new packet size (PS). Then, box 513 
is entered to determine the state of the queue 
(Queue_State) with regard to the queue states ST(1)- 
ST(N) defined above. When the queue state, ST(k) (with 
k being an integer comprised between 1 and N) is de- 
termined, then counters PT(1 ) to PT(k) are incremented. 
The process continues with decision box 515, where it 
is tested whether monitoring period T is completed or 
not. If not (NO), the process recycles to box 505 to re- 
ceive a new packet. If so (YES), the process ends with 
box 517 in which all counters values PT(1 ) to PT(N) are 
divided by: Z PT{i) 
With 



Z PT{i) =PT{^)+PTi2) +.,. +PT{N) 

[0024] That way final values PT(i) obtained express 
each the percentage of packets that have arrived during 
monitoring period T while the queue was in any of the 
states ST(i) to ST(N). In other words; each value PT(1) 
to PT(N) indicates respectively the percentage of pack- 
ets that have arrived during monitoring period T while 
the queue size (Qsize) was equal or greater than re- 
spectively threshold T(T) to T(N). 
Finally in box 517, final values PT(1) to PT(N) are re- 
trieved by the General Purpose Processor of the adapt- 
er, so that these values are available to be polled by the 
bulk statistics server After box 517 is complete, the 
process recycles at in it box 503 to initialize a new mon- 
itoring period. It should be noted that period T should be 
chosen such as to avoid counters overflow. In the pre- 
ferred embodiment of the invention, period T is chosen 
to be 15 minutes. 

[0025] In parallel with the foregoing process de- 
scribed in connection with FIG. 5, each time a packet 
has been successfully transmitted from the queue over 
an outgoing link (250), the queue size (Qsize) is accord- 
ingly decremented by the size of the packet. Thus, after 
each monitoring period T and for each queue (340), it is 
obtained an evaluation of the time distribution of the 
queue occupancy with reference to the thresholds T(1 )- 
T(N) chosen during the monitoring period (T) consid- 
ered. This queue occupancy evaluation is available 
through a set of N values: PT(1) to PT(N). Each value 
PT(i) indicates the percentage of packets that have ar- 
rived during monitoring period T while the queue size 
(Qsize) was equal or greater than threshold T(i), with T 
(1) expressed in percentage of the total queue capacity 
It is therefore clear that such evaluation of the time dis- 



tribution of the queue occupancy takes into account the 
character bursty or non bursty of the traffic flowing over 
the link monitored while it is not reflected in the prior art 
average link utilization technique. 

5 Note : "Bursty" refersto variable bit rate traffic where the 
time between data transmission is not always the same. 
[0026] Now with reference to FIG. 6, there is shown 
a schematic blockdiagram illustrating a general network 
management architecture in which counters values at 

10 node level are retrieved and used to build network sta- 
tistics and do capacity planning. In FIG. 6, only one net- 
work node 601 is represented for simplicity of illustra- 
tion. In node 601 a switching fabric 210 connects a plu- 
rality of adapters 220. Still in node 601, a Control Point 

'5 processor (CP) 611 provides the network control func- 
tions. Adapters 220 include memory locations 609 
where adapter counters values are stored. As illustrat- 
ing by arrows 613, Control Point processor 611 central- 
izes periodically the different counters values measured 

20 during the miaasurement periods. These data are peri- 
odically sent to the bulk statistics server 603 as shown 
by arrow 617 which collects in background all the sta- 
tistics from all the network nodes, usually at night. Sta- 
tistics server 603 sends periodically or on demand the 

2S statistics files containing data for all the network re- 
sources to a network monitoring center 605, as shown 
by arrow 625. In the network monitoring center 605, hu- 
man operators use these files to monitor the network 
resources and take the appropriate network monitoring 

30 actions, e.g., capacity planning actions. Network moni- 
toring actions are performed through a network man- 
agement console 607 typically a personal computer or 
workstation as illustrated by arrow 621. The network 
management console 607 transmits the network moni- 

35 toring commands to the Control Point processor 61 1 of 
the network nodes concerned, as illustrated by arrow 
623. Lastly, the counters values stored in memory loca- 
tions 609 of node adapters 220 may also be accessed 
directly in real time by a human operator through net- 

40 work management console 607. 

[0027] In the network management context described 
above in connection with FIG. 6, there will now be de- 
scribed how the general process of network resources 
(links and nodes) monitoring may be advantageously 

•fs used in conjunction with the new connection bandwidth 
managementtechniqueof the present invention in order 
toallowareallocation (herein referredtoas "rightsizing" 
or "re-sizing") of the bandwidth reserved (i.e. agreed- 
upon through the SLAs) of the connections boarded on 

50 a given link of the network. This process is referred here- 
inafter as "Connection Bandwidth Rightsizing" (CBRS) 
process 

[0028] The right sizing of the bandwidth resen/ed for 
the connections is justified, as previously stated, by the 
55 obsen^ation that network customers usually take some 
margin in the bandwidth requested fortheir connections, 
e.g., to anticipate an increase of theirtrafftc, or because 
they cannot evaluate accurately their current and future 
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needs. The foregoing results in that there is most of the 
time an important difference between the bandwidth re- 
served (CIR in Frame Relay) by the users for their con- 
nections and the actual bandwidth used. 
These "right sizing" actions are taken responsive to the 
analysis of the resource monitoring information, i.e., the 
average link utilization and/or of the link buffer occupan- 
cy statistics, and are triggered in the network monitoring 
center 605 of FIG. 6. The connections "right sizing" ac- 
tions are transmitted through the network to the Control 
Point processors of the ingress access nodes (e.g. 
nodes 101,102 of FIG. 1) of the network where the con- 
cerned connections have been originally set out. 
[0029] Referring backto FIG. 6, the GBRS process is 
illustrated by additional arrow 627 extending from net- 
work monitoring center 605 to Control Point 61 1 of node 
601 which, in this case, represents a network ingress 
access node. Arrow 627 corresponds to the modifica- 
tions brought to the connection parameters in order to 
re-size its allocated bandwidth, at its oMgin node. This 
is performed by means of dedicated commands auto- 
matically sentthrough the network by the computer sys- 
tem In charge of the CBRS process, from the monitoring 
center (605) to the origin switching node (601). 
[0030] Following is a description of a preferred em- 
bodiment of the Connections Bandwidth Right Sizing 
(CBRS) process according to the invention. It should be 
understood that, while the network considered is based 
on Frame Relay technology, the CBRS process of the 
invention could also be implemented in another high 
speed packet/cell switching technology such as the 
ATI\/I technology for example. 
[0031] In a Frame Relay packet iswitching network, 
the maximum number of bits per seconds which an end 
station can transmit into the network is bounded by the 
access rate of the user-network interface. The access 
rate is limited by the line speed of the user-network con- 
nection and established by subscription. 
The maximum committed amount of data which a user 
may offer to the network is defined as committed burst 
size (Be). Be is a measure for the volume of data for 
which the network will guarantee message delivery un- 
der normal conditions. It is measured during the com- 
mitted rate measurement interval (Tc). 
End stations are allowed to transmit data in excess of 
the committed burst size. The excess burst size (Be ) 
has been defined as the allowed amount of data by 
which a user can exceed Be during the committed meas- 
urement rate interval Tc. If spare capacity exists the net- 
work will forward the data to its destination. The network 
however is free to mark the data as discard eligible (DE). 

[0032] The committed infonvation rate (CIR) has 
been defined as the allowed amount of data which the 
network is committed to transfer under normal condi- 
tions. The rate is averaged over an increment of time 
Tc. The CIR is also referred to as minimum acceptable 
throughput. The Be and Be are expressed in bits, Tc in 
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seconds, the access rate and CIR in bits per second. 
Be. Be , Tc , CIR are defined per DLCI (Data link Con- 
nection Identifier), the access rate is valid for per user- 
network interface. For permanent virtual circuits Be (in- 
s coming and outgoing), Be (incoming and outgoing) and 
CIR (incoming and outgoing) are defined at subscription 
time. Tc is calculated as follows: 
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(1) 



[0033] Each time, a user requests a new connection 
to be established, the network operator, through its op- 
eration/design teams, checks whether the new connec- 

'5 tion defined by its access rate, CIR and Be requested 
by the user can be accepted by the network (in terms of 
resources availability). If not, the new connection re- 
quest is rejected. If so, a corresponding amount of band- 
width or network capacity is reserved to that connection. 

20 Then, each reserved bandwidth connection provides a 
set of traffic descriptors to the network in the form of an 
entry in a dedicated table, herein referred to as "Con- 
nection Table" stored in a database memory in all the 
network nodes. In Frame Relay the Connection Table 

25 basically contains an identifier of each connection (DL- 
CI), its origin and destination ports, and its associated 
CIR, Be, Be, Access Rate. Another table, herein referred 
to as "LinkTable", is associated to the networklinks. The 
Link Table, which is also stored in the database memory 

30 of the nodes, contains link descriptors containing infor- 
mation such as the total link capacity (bandwidth), the 
bandwidth reserved per class of service, the link avail- 
ability, or the link propagation delay The Connection Ta- 
ble and the Link Table will be further described in con- 

35 nection with FIGs. 7A-7B, 

[0034] At network ingress access node level, the task 
of Call Admission Control (CAC) is performed. The CAC 
task is basically the process of analyzingthe parameters 
of a new connection (in the Connection Table), In order 

40 to decide whether the connection should be accepted 
or not in function of the availability of the network 's re- 
sources. 

[0035] Still at ingress access node level there is per- 
formed the process of user traffic policing. Traffic polic- 
45 ing is a process of adjusting the incoming traffic to en- 
force conformance with the agreed-to mean and burst; 
these aclions will only impair non-conforming connec- 
tions. Three techniques can be used: 

50 Delay Slowing down non-real-time packets such 
that they are submitted to the network over 
a longer time period (in other words, in less 
of a burst). This is also known as srhoothing 
the traffic. Smoothing the traffic better utiliz- 

55 es overall network bandwidth; it is done only 

within the agreed-to quality of service. 
Tagging Marking packets as Excess when they arrive 
above the committed burst rate. Typically, 
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when bursts of packets are larger than Be 
but lower than Bc+Be, packets above Be are 
tagged, i.e., Discard Eligibility {DE) bit on. 

[0036] Note : Packets marked excess are also called 
red packets, while hon-exeess packets are called green. 

Discarding Discarding packets that arrive at a rate 
larger than the committed rate plus the 
extra rate being allowed as Excess. Typ- 
ically, when bursts of packets larger than 
Bc+Be are sent at the Access Rate, 
packets above Bc+Be are discarded. 

Tagging and discarding are typically performed by the 
well-known leaky bucket algorithm. 
[0037] Note : A similar process is done in ATM net- 
works with the corresponding parameters: PGR (Pea^r 
Cell Rate), SCR (Sustainable Cell Rate), and MBS 
{Mean Burst Size) instead of respectively Access Rate, 
CIR, and Be. 

[0038] As a consequence of the policing process 
which operates at the entrance of the network, if for a 
given trunk, the sum of the CIRs is less or equal to the 
trunk capacity that is, no oversubscription of the trunk 
is practised, the risk of network congestion is very low. 
Actually, network congestion states may still occur be- 
cause some excess traffic (Be) is accepted by the net- 
work on top of the committed/reserved traffic. However, 
this accepted excess traffic is tagged at the entrance of 
the network (Discard Eligibility on), which allows this 
traffic to be discarded first in case of congestion, and 
guarantee that the committed part of the connections' 
traffic will be transmitted successfully. 
Conversely if the sum of the CIRs is greater than the 
trunk capacity then the trunk is oversubscribed that is, 
the network is relying on statistical multiplexing to hope 
that every user does not askfor his CIR simultaneously 
Accordingly if a congestion appears due to a high pro- 
portion of users connected simultaneously as the traffic 
over each connection is non-excess traffic (DE off), then 
packets would be discarded randomly depending on 
their order of arrival in the queues of the network nodes. 
Thus, in this congestion case the minimum guaranteed 
traffic (CIR) per user would not be respected. 
The Connection Bandwidth Right Sizing (CBRS) proc- 
ess of the invention allows the same number of users 
being subscribed at the same time as when oversub- 
scription is practised, while minimizing the risk of con- 
gestion and still guaranteeing a minimum bandwidth to 
transfer traffic. 

[0039] With reference to FIGs. 7A-7B, there is illus- 
trated the contents of the Connection Table (FIG. 7A) 
and of the Link Table (FIG. 7B) in accordance with the 
invention. In FIG. 7A, Connection Table 700 is shown 
with various columns that correspond each to a partic- 
ular type of connection parameter. Fields in column 702 
correspond to the connections' identifier (DLCI in Frame 
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Relay). In table 700, for argument's sake, records for 
two connections having respectively identifier CI and 
C2 are shown. Fields in column 704 contain the original 
CIR (CIR) of the connections, that is, the CIR agreed- 
s upon at subscription time. Intable700, CIR is expressed 
in kilobits per second (Kbps). Fields in columns 706 and 
708 contain respectively the committed burst size (Be) 
and the excess burst size (Be) of the connections. Both 
Be and Be are expressed in Kilobits (Kb) in table 700. 
10 Fields in column 710 contain the access rate of the con- 
nections. The access rate is expressed in kilobits per 
second (Kbps) in table 700. The foregoing connection 
parameters (Connection ID, CIR, Be, Be, and access 
rate) are typically found in the Connection Table. Ac- 
's cording to the invention, there are two additional param- 
eters per connection recorded in the Connection Table. 
These additional parameters are referred to as "CRF" 
and "NCI R", and correspond to the fields which are con- 
tained respectively in columns 712 and 714. CRF pa- 
20 rameter stands for "Connection Right Sizing Factor", 
and NCIR parameter stands for "New CIR". CRF and 
NCIR are respectively initialized to 1 (one) and to CIR 
value at connection setup. CRF parameter is indicative 
as to whether the connection has been already "right 
25 sized" or not. These two additional parameters will be 
described further in connection with FIG. B. 
[0040] Now referring to FIG. 78, Link Table 720 is 
shown. As previously stated, Link Table 720 is associ- 
ated to the network links and provides information rela- 
30 tive to all the network links, typically such as: the total 
link capacity (bandwidth), the bandwidth reserved per 
class of sen/ice, the link availability, or the link propaga- 
tion delay For simplicity of illustration, in FIG. 7B, Link 
Table 720 is shown including only the parameters that 
35 are used by the CBRS process according to the inven- 
tion. Table 720 includes three columns: first one at 722, 
contains fields that correspond to the links' identifier In 
table 720, for argument's sake, records for one link (LI ) 
is shown. Columns 724 and 726 corresponds to link ad- 
40 ditional parameters that are used in the Connection 
Bandwidth Right Sizing process of the invention. First 
additional parameter "Link Right Sizing Factor" (LRF) 
corresponds to the fields which are contained in column 
724. Second additional parameter "Link Oversubscrip- 
45 tion Factor" (OVF) corresponds to the fields contained 
in column 726. OVF parameter is expressed in percent- 
age (%) and represents the ratio of oversubscription of 
the link. 

[0041] For example, let's consider an 0C3 link which 
so has a sen/ice rate of 155 Mbps (megabits per second). 
If the ratio of oversubscription (OVF) of this OC3 link is 
400 %, then it means that the sum of the CIRs of the 
connections boarded over the link is four times its serv- 
ice rate (actual maximum bandwidth available on that 
55 link), that is, 620 IWbps. If no oversubscription is applied 
on that link, then the sum of the CIRs of the connectbns 
boarded over the link is less or equal to the link capacity 
that is, 155 Mbps. In the latter case OVF is equal to 100 
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%. 

The LRF parameter associated to a given link indicates 
whetlier or not tlie CBRS process lias been applied to 
that linl<. LRF is initialized to OVF/100. After the CBRS 
process run on that linl< is complete, the LRF parameter 5 
associated to the link in table 720 is set to 1 . As shown 
in table 720, link LI in the table is oversubscribed with 
a ratio (OVF) of 400 %. However the CBRS process has 
not been run yet on this link since its LRF parameter is 
still equal to 4. io 
Additional link parameters LRF and OVF will be used in 
conjunction with the connections additional parameters 
CRF and NCIR In the Connection Bandwidth Right Siz- 
ing (CBRS) process of the Invention, as will be de- 
scribed hereinafter, in connection with FIG. 8. '5 
[0042] FIG. 8 is a flow chart illustrating the Connection 
Bandwidth Right Sizing (CBRS) process of the inven- 
tion. CBRS process is implemented in the form of com- 
puter programs which run In a monitoring-dedicated 
computer in the network monitoring center (FIG. 6, 605). 20 
CBRS process is automatically triggered in the network 
monitoring center (FIG. 6, 605), upon receiving of the 
network links monitoring reports which include the av- 
erage link utilization and/or of the lini< buffer occupancy 
statistics. Usually, the monitoring reports are received 2S 
every night in the network monitoring center, and a typ- 
ical frequency for running the CBRS process Is from one 
to some days. The CBRS process Is a background type 
process. 

It should be noted that while, In the preferred embodi- so 
ment of the invention, the CBRS process utilizes both 
the average link utilization statistics and the link buffer 
occtypancy statistics for more efficiency, the CBRS prin- 
ciple could also be implemented with only the average 
link utilization statistics used , 3s 
[0043] In FIG. 8, the CBRS process of the invention 
is initiated, starting at start box 800, whenever the net- 
work links monitoring reports are received. At that time, 
all links of a link list stored In memory will be processed 
sequentially starting with the first link of the list. Then, 40 
box 802 is entered to retrieve the statistics values cor- 
responding to the selected link, from the links monitoring 
reports which are stored in a computer memory in the 
network monitoring center 

The link associated statistics values Include: « 



18 

[0044] After step at box 802 Is complete, decision box 
804 is entered where it is determined whether the link 
packet loss is greater than the SLA (service level agree- 
ment) requirements associated with the connections 
boarded on the link If the link packet loss (Packet_Loss) 
Is larger than the SLA, it means that the link Is already 
not capable of providing a good level of service with re- 
gard to the SLA because it is overloaded. In that case 
(YES), box 806 is entered to reroute some of the con- 
nections which are currently boarded on the link, until 
the selected link packet loss is less than the maximum 
packet loss allowed (SLA), as shown by re-entering box 
804. Then, if the selected link packet loss is less than 
the SLA requirements (NO), box 808 is entered to test 
whether the Link_Use is greater than a first predeter- 
mined value U1 which is equal to 80 % in the preferred 
embodiment of the Invention. If not (NO), decision box 
81 0 is entered to test buff er occupancy valu es PT(3) and 
PT(4). If PT(3) is greater or equal to a first predeter- 
mined buffer occupancy value P1 , OR If PT(4) Is greater 
or equal to a second predetermined buffer occupancy 
value P2, it means that: 

Either the percentage of packets PT(3) that have arrived 
during the monitoring time period while the queue occu- 
pancy (Osize) was equal or greater than T(3) is greater 
or equal to PI OR the percentage of packets PT(4) that 
have arrived during the monitoring time period while the 
queue occupancy (Qsize) was equal or greater than T 
(4) is greater or equal to P2. In the preferred embodi- 
ment of the invention, T(3)= 40%, T(4)=70%, PI =60%, 
P2=10%. 

If no t (81 0, NO), the process aborts as shown by enter- 
ing terminal box 822, another link can be selected and 
the CBRS process restarted. 
If so (810, YES), box 81 2 is entered to select a first con- 
nection (Ci) boarded on the link, I.e., select Its associat- 
ed ID In Connection Table 700, 
Then, decision box 814 Is entered to test whether or not 
the Connection Right Sizing Factor, CRF(CI), associat- 
ed to the selected connection Ci, in Connection Table 
700, is greater or equal to the Link Right Sizing Factor 
(LRF) associated to the selected link in Link Table 720. 
CRF(Ci) can be determined to be greater or equal to 
LRF in the following cases: 

Connection Ci has been already "re-sized" (CRF 
(Ci) > 1) when the CBRS process was run on an- 
other link along the path allocated to that connection 
through the network. 

Connection Ci has not been re-sized yet (CRF(Ci) 
=1), while current link is not oversubscribed 
(LRF=1). 

[0045] If CRF(Ci) is determined to be greater or equal 
to LRF (814, YES) then selected connection Ci is kept 
unchanged (NCIR=CIH) as shown by entering box 816. 
Then, the CBRS process recycles entering box 812 to 
select another connection boarded on the link. 



the associated dally or weekly average link utiliza- 
tion statistics ("Link_Use"); 
the associated link buffer occupancy statistics ("FT 
(I) values"), i.e., the averaged PT(i) values (PT(1) so 
to PT(4) in the preferred embodiment), with each 
value PT(i) indicating the percentage of packets 
that have arrived during the long term period con- 
sidered while the queue size (Qsize) was equal or 
greater than threshold T(i); 55 
the link packet loss ratio ("Packet_Loss"), i.e. the 
percentage of packet discarded due to congestion 
during the long term period considered. 
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[0046] Conversely, if CRF(Ci) is determined to be less 
than LRF (814, NO) then box 818 is entered to perform 
the actual Connection Bandwidth Right Sizing (CBRS) 
step on the selected connection (Ci). In box 818, box 
818A Is entered first to perform the first sub-step of the 
CBRS step, that is, computing a new CIR for connection 
CI (NCIR(CI)), and updating accordingly the connection 
right sizing factor (GRF(Ci)). The new CIR and the up- 
dated CRF are respectively recorded into the fields cor- 
responding to connection Ci, in respectively column 714 
and 712 of table 700. 

Then, after step In box 818A is complete, box 818B is 
entered to perform a second sub-step In which param- 
eters Be and Be associated to the selected connection 
are re-computed to reflect the new CIR (NCIR). Newly 
computed Be and Be of the connection (herein referred 
to as NBe(CI) and NBc(Ci)) are recorded into the fields 
corresponding to connection Gi in respectively column 
708 and 706 of Connection Table 700. Details on how 
CRF, NCIR, NBe and NBc are calculated will be provid- 
ed further in the description. 

When CBRS step at box 818 is complete, decision box 
820 is entered where it Is determined whether all con- 
nections which are presently boarded on the selected 
link have been processed or not. If not (NO), box 81 2 is 
re-entered In order to select another connection to apply 
the CBRS step (818) on. Conversely If all the connec- 
tions boarded on the selected link have been processed 
(820, YES), then box 822 Is entered to set the LRF pa- 
rameter of the selected link to 1 (one) in Link Table 720. 
Finally, terminal box 824 Is entered to complete the 
CBRS process run on the selected link. Another linkmay 
now be Selected and the CBRS process started on it. 
[0047] Therefore, after all the network links have been 
processed by the CBRS process, each one of the con- 
nections established through the network is allocated a 
"re-sized" bandwidth (NCIR) which corresponds to the 
original bandwidth (CIR) that has been divided by the 
highest link oversubscription factor (OVF) of all the links 
along the path selected through the network for that con- 
nection. 



calculated according to the following formula: 

NCIR{C\) = ^!^ (2) 

5 

Where LRF is the "Link Right Sizing Factor" (LRF) of the 
link. 

[0049] And the CRF parameter of the connection 
(CRF(Ci)), which was initialized to 1 is set to the link LRF 
10 value: 



CRF(C\)=LRF 

-IS [0050] Forexample,inLinkTable720ofFIG. 78, link 
LI Is oversubscribed at 400% (oversubscription factor, 
OVF= 400), its right sizing factor LRF has been Initial- 
ized to 4 (OVF/100). Now suppose that connection CI 
in Connection Table 700 is one of the connections that 

20 are boarded over link LI . As shown in column 704 of 
table 700, connection CI has an original CIR of 200 Kb- 
ps, while its re-sized CIR (NCIR) in column 714 is equal 
to 50 Kbps, that is: 



[0051] And its CRF is equal to 4, that is: 

30 

CRF{C1)^LRF{Li) 

[0052] Now having regard to connection C2 in table 
700, one can see that its new CIR (NCIR) in column 71 4 
35 is equal to Its original CIR in column 704, I.e., 64 Kbps. 
This means that connection C2, is either boarded over 
a path whose links are not oversubscribed (OVF 
=100%), or none of the links of the path have been 
passed through the CBRS process yet. 

40 

Be and Be recalculation 



NCIR and CRF calculation 

[0048] Let us consider a given monitored link of the 
network. As previously stated In connection with FIGs. 
7A-7B, each connection Ci is defined through a set of 
parameters including the committed Information rate 
(CIR), Its committed burst size (Be) and its excess burst 
size (Be). When the link is passed through the Connec- 
tion Right Sizing process, if the link is oversubscribed 
(LRF > 1 ) each of its connections, Ci, is 're-sized' if CRF 
(Ci) Is less than LRR that is, its CIR Is recalculated and 
is recorded in table 700 in the NCIR (New_CIR) corre- 
sponding field. Accordingly, the CRF parameter of the 
connection is updated to indicate the ratio of re-sizing 
of the connection. 

According to the invention, NCIR for connection Ci is 



[0053] As previously stated after new CIR (NCIR) is 
computed for a given connection (boxSIBA, FIG. 8), the 
45 Be and Be parameters associated to the selected con- 
nection are re-computed to reflect the new CIR (NCIR) 

(box 81 SB). 

The committed burst size (Be) and the excess burst size 
(Be) parameters of the connection must be re-computed 
50 to induce the same amount of traffic boarded over the 
link before and after the link is passed through the CBRS 
process. In Frame Relay the total amount of traffic ac- 
cepted per connection Ci is typically: 

55 Be 

C/fl(1+g) (3) 

[0054] Consequently, in order to keep the same 
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amount of traffic accepted for the connection after its 
CIR fias been re-sized, Be and Be must be re-evaiuated 
such that the foiiowing equation is verified: 



agreed-upon bandwidth through the network, with 
each of the communication linl^s being possibly 
oversubscribed; 

said connection bandwidth management process 
being characterized in that it comprises the steps of: 



[0055] Besides, according to equation (1 ) above we 
have: 

75 

Be ^ jysc 

CIR NCIR ^ ' 

with Tc being the committed measurement rate interval. 
[0056] From the foregoing equations (V), (2') and (4), 20 
new Be and Be (NBe and NBc) can be expressed as 
follows: 



NBs=(Bc-NBc)+Be ^ 

[0057] While the invention has been described in 
terms of a preferred embodiment, those skilled in the art 

will recognize that the invention can be practised with 
v,ariations and modifications. Therefore, it is intended 35 
lhal Ihe appended claims shall be construed to include 
both preferred embodiment and all variations and mod- 
ifications thereof that fall within the scope of the inven- 
tion. 



A connection bandwidth management process for 
use in a high speed packet switching network (100) 4* 
comprising a plurality of switching nodes (101-106) 
interconnected through a plurality of communica- 
tion links (107), each of the switching nodes com- 
prising means (210) for switching packets from at 
least one input link (250) to at least one output link so 
(250), each of said at least one output link (250) be- 
ing coupled to at least one buffer (340) in the switch- 
ing node for queuing packets before they aretrans- 
mitted over the output link, each of said communi- 
cation linkssupportingthetrafficof a plurality of us- 55 
er connections statist icallymultiplexedover the link, 
each user connection being allocated an initial 



a) periodically receiving in a network monitoring 
center (605) link monitoring data on said com- 
munication links (107), and storing said link 
monitoring data in a computer memory in said 
network monitoring center (605); 

b) selecting one monitored link and retrieving 
(802) the corresponding link monitoring data 
from said computer memory; 

c) analyzing the link monitoring data for said se- 
lected link; 

d) determining whether said selected link is 
oversubscribed or not; 

e) upon determining that said selected link is 
oversubscribed (814) and that said link moni- 
toring data for said selected link satisfies at 
least one predetermined condition (804, 808, 
810), reallocating the bandwidth initially allo- 
cated to each of the connections boarded on 
said selected link (812, 814, 818, 820), such 
that, the sum of the reallocated bandwidth of 
said connections boarded on said selected link 
is less or equal to Ihe total bandwidth capacity 
of said selected link; 

f) starting again preceding steps b) to e) until 
all the links monitored have been selected. 

A connection bandwKlth management process as 
claimed in claim 1 wherein said link monitoring data 
includes for each of the monitored links, a time dis- 
tribution of the occupancy of said at least one buffer 
(340) measured during a predetermined monitoring 
time period. 

A connection bandwidth management process as 
claimed in claim 2 wherein said time distribution of 
the occupancy of said at least one buffer (340) is 
obtained by: 

defining a plurality N, with N being an integer, 
of buffer occupancy thresholds T(1) to T(N), 
each of said thresholds being indicative of a ra- 
tio of the total occupancy of the buffer (340); 
defining a plurality N of buffer states ST(1) to 
ST(N), each of said states being indicative of 
the amount of packets stored in the buffer at a 
given instant in relation to said thresholds T(1 ) 
to T(N); 

defining a plurality N of counters, PT(1) to PT 
(N), each of which, PT(i) with i being an integer 
comprised between 1 and N, being increment- 
ed when the buffer state is determined to be at 
any of the states ST(i) to ST(N). 
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whereby the measurement of the time distribution 
of the occupancy of said at least one buffer (340) 
during a predetermined monitoring time period is 
achieved by obtaining a set of N values PT(1 ) to PT 
(N) indicating respectively the percentage of paci<- s 
ets that have arrived during said monitoring period 
while the amount of pacl<ets stored in the buffer at 
the packet arrival instant was equal or greater than 
respectively threshold T(1 ) to T(N). 

10 

4. A connection bandwidth management process as 
claimed in claim 3, wherein said number N of buffer 
occupancy thresholds, of buffer states, and 
counters is four, and wherein the buffer states ST 
(1) to ST(4) are defined as follows: '5 

ST(1): Buffer state when T(1) <= Qsize < T(2); 
ST(2): Buffer state when T(2) Qsize < T(3); 
ST(3): Buffer state when T(3) <= Qsize < T(4); 
ST (4): Buffer state when Qsize >= T(4). ?o 

where "<=' stands for "less or equal to", and ">=" 
stands for "greater or equal to", and where "Qsize" 
refers to the amount of pacl<ets stored in the buffer 
at a given instant. 25 

6. A connection bandwidth management process as 
claimed in claim 4, wherein said buffer occupancy 
thresholds T(1 ) to T(4) are indicative respectively of 
5 percent, 20 percent, 40 percent, and 70 percent so 
of the total occupancy of the buffer. 

6. A connection bandwidth management process as 
claimed in any of the preceding claims wherein said 
Wnk monitoring data includes for each of the moni- 35 
tored linlcs an average linl^ utilization data for each 

of said Wnks, said average link utilization data rely- 
ing on the counting of packets during a predeter- 
mined monitoring time period before they are 
boarded on the link 40 

7. A connection bandwidth management process as 
claimed in any of claim 2 to 6, wherein the step of 
determining whether said link monitoring data for 
said selected link satisfies at least one predeter- 
mined condition (804, 808, 810), is achieved by 
testing the buffer occupancy time distribution (810) 
data and the average link utilization data (808) of 

link. 



8. A connection bandwidth management process as 
claimed in claim 7, further using (804) for each se- 
lected link, the percentage of packet discarded 
(Packet_Loss) during said predetermined monitor- 
ing time period, to determine whether said at least 
one predetermined condition is satisfied. 

9. A connection bandwidth management process as 



claimed in any of the preceding claims further com- 
prising the steps of: 

defining for each communication link a first pa- 
rameter (OVF) indicative of the ratio of oversub- 
scription currently applied to the link, and a sec- 
ond parameter (LRF) indicative as to whether 
or not the link has been passed through said 
connection bandwidth management process 
(CBRS), with said first parameter (OVF) being 
expressed in percentage of oversubscription 
and said second parameter (LRF) being initial- 
ized to a value corresponding to said first pa- 
rameter (OVF) divided by 100; 
defining for each connection a third parameter 
(CRF) indicative as to whether the connection 
bandwidth has been already reallocated or not, 
with said third parameter (CRF) being initialized 
to one at connection setup; 
comparing (814) for each connection boarded 
over said selected link said third parameter 
(CRF) to said second parameter (LRF) of said 
selected link; 

keeping (816) the connection allocated band- 
width unchanged upon determining that said 
third parameter (CRF) is equal or greater than 
said second parameter (LRF); and 
re-computing (818) the connection bandwidth 
parameters whereby said connection band- 
width is reallocated, upon determining that said 
third parameter (CRF) is equal or greater than 
said second parameter (LRF). 

10. A connection bandwidth management process as 
claimed in claim 9 implemented in a Frame Relay 
network, wherein said connection bandwidth pa- 
rameters which are re-computed in said re-comput- 
ing step (818) comprise the committed information 
rate (CIR), the committed burst size (Be), and the 
excess burst size (Be). 

11. A connection bandwidth management process as 
claimed in claim 10, wherein said connection band- 
width parameters CIR, Be, Be are re-computed 
(818) according to the following formulae: 

MniR - 91^ 



with CIR being the original CIR allocated at 
connection setup, and NCIR denoting the re-com- 
puted CIR; 
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/vee=(ec-A/ec)+ee 

with NBc and NBe respectively denoting tlie re- 
computed Be and tine re-computed Be; s 
such that the same amount of traffic is accepted 
through the networlcforthe connection after its com- 
mitted information rate (CIR) has been re-comput- 
ed. 

10 

12. A connection bandwidth management process as 
claimed in any preceding claim wherein the step of 
reallocating the bandwidth initially allocated to each 
of the connections boarded on the selected link is 
performed through commands transmitted (627) is 
from said network monitoring center (605) to the or- 
igin switching node (601) in which the connection 
was originally set up. 

13. A computer system for use in a high speed packet 20 
switching network, said computer system compris- 
ing means adapted for carrying out a process ac- 
cording to any one of the preceding claims. 
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